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The theoiry underlying ERGO is founded- in ordering theory (Airasian & 
Bart. 1972), with its interpretation of dominance relations following logical 
imp 1 icat ives Similar to Boolean algebra. The redefinition of dimensionality 
using bl)th the notion of dominance rela tions- and that ' of ./logical'!^ pr erequisities 
can more >iptly be identified with the definition pf a Guttman order, thereby 
placing emphasTis on the developmental aspects of recovered sets of dimensions. 
It is this interpretation th^t allows for the duality of; relationships between 
persons and items. The resulting placement o£ both persons and items on the 
same unid imensiona 1- cohstr.uc t presents the researcher with the opportunity to 
observe direct relations between the two. " / 

A preliminary attempt to. utilize the apparent advantages associated with 
the extraction procedure based on dominance rela tions, / order analysis (Krus, 
Bart, & Airasian, 1975) is used. This is done both to fur ther' explicate the 
implications of ordering theory as well as to point oii t the issues with which 
a d imensional i zing procedure af this^ type'must concer/h itself. In/this discus- 
sion, the procedural sho||tcomi'ngs of 'order analysis afre presented to acquaint 
the reader with the obstacles that an alternative approach must overcome. 
^Premier among these is the failure of order analysis/ to consider the true nature 
of mul tld ijnensional ity in a dominance matrix contexc. This appears in the 
order analytic assumption that counter dominance relations are merely a pro-^ 
duct of error, rather than being manifestations of /the multidiirfensional. nature 
of the data. The alternat ive procedure (ERGO) is aeveloped by dearling with 
this essential point. / 

The key to the dimension extraction problem off ERGO .rests in the f ormulation 
of an index of dimension consistency that- is comparable to classical measures 
such as the Kuder-Richardson formulae (1937) and the Loi*^v?nger homogeneity^ 
indices (19A7). CI f f f (1975b), by demonstrating khe rei a txon between these 
classical indices and their redefinition in a dominance Ttf.a trix context, lays - 
the foundation for the development of a»n alternative proced'^re. Thus, ,by 
adopting a consistency measure developed there,/ ERGO' iteratively adds items ' 
together, resulting in the construction of various sets of implicative chains 
representing dimensions. Having constructed tne^e chains, the ERGO procedure 
orders the chains in terms of maximal number of / items qontributed. The chain 
evaluation procedure can best be explained as an a ttemp t -to .maximize the 
number of items accounted for in a given dimens/ional solution. 

give additional understanding of both 
tial advantages j pr(>cedure of this type offers 
utilizes sAci.il distance items (Bogardus , - 1925] 



jhe tRGO process and the poten- 
an empirical example which 
paired individually with 



three etfinic: groups was analyzed for *spondents representing four ethnic 
groups. Bmph;is ized^Jn the solution was the dun lity of relationships inher^^nt 
in a procedure suchMs this, that is based updn the principles underlying 
(luttman orders. The results demonstrated the lability of F*]RGO to (1) group 
items 'referring to the s/ime ethnic ^roup; (2) (uncover hierarchically graded 
orders within e.ich ch.iin; (3) select the thre'^ chains th;it coV responded to the 



three ethnic groups; 
their sN'ores. 



.uui (4) c luster ^individuals by etimic group according t( 
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IHTRODUCTION 

The extraction of factors or dimensions from a data matrix las 
preoccupied many a psychometric ian, and methods developed to accom-. 
plish this task have taken many forms , From their fundeunental begln- 
nings in factor' analytic theory (Spearman^ 1904) to the more recent, 
multidimensional scaling J)rocedures (MDS) (Shepard, I962), to the most 
recent, ordering theory (Airasian & Bart/ 1972), allTmethod^ have the 
^ conmon concern of the ideo^f ication of unidimensional structures 
within a postulated multidimensional context. To date, more tradi- 
tional methods of factor analysis and multidimensional scaling have 
tfallen short in attacking the dimensionality problem -specif ic to the 
binary matrix (Horst, I965). Isolating unidimensional hierarchies 
within a binary structure has recently undergone revision based upon a 
unique theoretical conceptualization known as order an^y sis (Krus, 
Bart, & Airasian, 1975). ' 

Instead of creating "artificial" measures of association, e.g., 
-^i common correlation*coef f iclent or distance measures, order analysis 
utilizes a'lo^ic model. It' attempts to isolate the Iqgical . orders 
among variable*, - and thus produces unidimensional components commonly 
kuoWnjfes Guttman scales (Guttman, l^kk) . Using the terminology of 
Horel/ (1965) and La^rsfeld (1958), ofder analysis can be desc^J>ed 

/ 



broadly as the process of isolating the underlying structures of latent 
entities and attributes within a given response sfet. 

Logj.cal procedures for uncovering hierarchical graded orders 
via the conftructioh of unid1 mens ional sca^tes have both practical as 
well a^ theoretical ^significance. The controversial issue of exaunining 
the binary relations in a test item by person response matrix serves to 
illustrate this problem. Though notably hampered by distributional 
assumptions abd also by the choice of an inter-item measure of associ- 
ation^ the use of classical factor analysis persists as the principal 
. "type of dimen&ionalizing procedure. Far more serious them the above 
mentioned drawbacks^ however^ is the failure of the factor analytic * 
procedures to take into account the difficulty prder of ^the items. 
Because ' of the ■'fundamental role of item difficulty in test theory, 
this failure excludes factor analysis as a desired alternative, and 
sxiggests the use of a dimen^ionalizing system that takes into account 
the item difficulties. The ^present article suggests such a procedure, 
based upon sound measurement principles underlying the Guttman simplex. 

The vaJ.ue of relying on such a fundamental notion as Guttman- 
type scales offers pother, and potent-ially everu^ore significant, I 
advantage. Instead of regarding items, ^^Lrticularly alttitudinal. ^ 

items; in a non-theoretical manner as would be the case with factor 

♦ ■ • . t 

analysis, the possibility of inferring a qualitative structure among , 
variables is appealing. This possibility, stemming from the develop- 
mental notion upon which Guttman scales rely, differs from the com- 
pensatory theory of behavior upon whici; factor analysis necessarily 

♦ * 6 



rests. Thus, Giittman-type scales allow for the consideration of 
various logic models of behavior, i.e., those of a conjunctive or dis- 
junct>Lve nature (Levy, 1975)- liogic models such as these allow for 
the identification of the developmental prerequisites to attitudes, 
and, at the same time, allow fon different developmental orders. 
^ Recently, the development cC- a dimensionalizing system that 

works with the logical relationship of a Guttman simplex — ordering 
theory — has been proposed (Krus, Bart, Airasisua, 1975)- Its 
accepta,nce, ■ however, has been forestalled" by a number of procedural 
shortcomings. Foremost among these is the failure to develop consist- 
ency indices which ijelate ^to other more common cpnsistencjj descrip- 
*tives, such as the familiar Kuder-Richardson formulae (1957)^ and the [ 
Loevinger homogeneity* indices (19^7)- A solution to this problem has. 
Aeen formalized by Cliff (l975b^ in the development of - a scries cjf 

1 • ^ 

measures constructed from the- item-by-item dom^|«ce matrices. Imp6r- 
'temtly, these measures of consistency constructed from dominance 
iqatrices parallel their counterpart in classical testi theory. The 
applfcation of these consistency measures offers arf* alternant ive^ 
methodology, based on souiyi measurement princ'iples, for the -id^ntif id- 
eation of unidimensionEuL st^^n^ure w^,^in an it^m-person context. Jn * 
the present study, a new factor extraction method founded' in the logi^ 
of ordering theory while also incorporating tJljXC^s (l975b) consist! 
ency indices will be presented. 'An empixical example using Guttman- 
liluit' social distance e^itudfe iteAs will be exajuined in an attempt to 
evaluate how well the model performs. * 



. Elements -o^ Ordering: Theory 

S impl^Orde r s L 

The construction of isomorphic number systems is the central 
issue of any structured psychologi research. An isomorphism refers 
to a similarity in pattern, viz., a situation where a. one-to-or^e 
relationship exists between an object and its numerical representa- 
tion. To illustrate, cpnsife^r the relationships among real numbet^^ 
which are actually meant to be representative of the interrelations 
9mion^ a *set of items or objects, On^ foundiatio^f this- real 'number 
system is that it can be linearly ordered. Thus> -the following three 
properties may be said to-be the axioms upon \hich this ordering •is'^ 
dependent (Coombs, Dawes, & Tversky, 197p, pp. 366-368). 

« ■ - * / ^ . 

asymmetric property - aRb Implies bRa where R medns not B 

transitive property - aRb and bRc implies aRc , 

conilected property - either aRb orX^Ra 

These axioms hpld- where R indicates the logical relationshi^typif ied \ 

•by "greater/than," ^d a, b, and c are entities in the system. 

. - ^ V • >^ 

e'xample of these three fundamental properties may be 

illustrated for the one-set dominance case (Coombs, I96U) more" com- 
monly eqioated -with a simple prefererfice ordering. A simple- order can 
be defined in te^s of the connecting relations that exist between all 
pairs ^^f^>he membejr St ^u^ A connecting -^lation is represented by 
a 1 in the row/ colimS^ designate of an otherwise null matrix. The 
matrix of connections, commonly known as an adjacency matrix, repre- 



sents a digraph (directed graph) where /the arc^ or connections between 
the vertices tag stimuli %re represented in the form* of a binary score' 
matrix (Harary, Normkn, 8t Cartwright^ I965). T^e -adjacency matrix in * 
•Lgure 1 represeQts 'a simple o'rdering between thr.ee items, .^.in th-e , 
preference context, the connective 1., implies t'hat the row istimulus is 
preferred to the column stimulus, $he -property of^« asymmetry' is • sAown 



byjijie absence or symmetric 1* s. And, J:he 'j.ack of anyT-ogical contra- 
dictions, such as aRb, bRc, or cRa, necess^trily suggest^^aBsivity • 
Thus a simple order, aRbRc, can be s^id to exist, 

^ ■ ■ ~ ■ i ■ 

As these essential axioms are the foundation for defining a 
simple order for members of - the saj^Cset,, so also do they hold for 
relations' t^etween twd different sets. The twb-si^t dominanpe classi- 
fication ( Coomb's j^P^PT), in this case, defers to a set of items and a 
set of pe\£Sons. '^I^persons by itims matrix seen in Figxire ■'2.^an ^ , 
I seen to fyleld-a simple difficulty ordering forz-iroms as welQ^as an 
ability ordering for persons, *This dioal i relationship is the basic 
cbncepfe underlying Guttman scales, which is represented by Figure 2, a 
perfect Guttman scale. or 4implex, 'Not only does theirs exist* an item 
difficulty and person ability ordering, but a' joa^t person-item order, 
as discussed ty Cliff (l975a), can also be constVi^jted as seen in 
Figure J, This joint- ordering can also be considered a^^simple order, 
thus operating under the same axiom^,^ ^ ,^ . 



^^s noted, these fuAdamental properties of relations between 
real numbers and the objects they represent (be they it^ms, persons, 

o© a combination of both) igive rise to defined orders. These proper- 

ft 

. . • ( 



ties, known as order reflations, ^proyide the basic Justification for the 
■atrix manipulative pl^ocedures developed below that attempt to utilize 

' / ■ • * ^ • • ' ■ ' 

logic structures as In solution to, the dimensionality problem. 

Logic Structures 

Syllogistic* reasoning, ' as originally fprmulated by Arlstgtle, 
demonstrates the use of simplq logic and its cognitive counterpart,*^ 
the' reflection of thought processes. Uie most basic of the traditional 
syllogisms is the'' conjunction of implicative relations, i.e., as 
A B and B ^ C then . This implicative chaining present in 
syllogistic reasoning, can also ^ considered as the development of a 
strai^t-line dimensional relationship congruent with the notion of 
simple order. An order, created by implicative relations, can be 
defined as a coiidition ofV ogical' arrangement aiziong certain specif i- 
cally related elements in a given set of items. 

For 1 sets of elements, say, a, b, c. It is possible to 
analyze the relationships between all possible response patterns (a 
plenum^., which can be separated into individual response patterns 
(see Table l). 

Table 1 was arranged upon considering all possible response 
patterns of values for each of the three elements, a, b, and c, as 
seen in step 1. Steps 2 and 3 are essentially using a syllogistic 
^^tation noting if the implication exists, "1," or doesn't exist, ''0." 
In step k, the conjunctive logic functioa; representing the logical 
truth of the Joining of steps 2 and 3, is again indicated by .a 

13 . . 



Table 1 



Three-dimensional Plenum 



Response 
Patterns 


Logical Structure 


Coopatlole 

Response 

Patterns 


.ABC 


(A - B) & (B - C) 


ABC 


1 1 1 ■ 
110 
10 1 
10 0 

oil 

0 10 
0 0 1 
X) 0 0 


'1 1*1 
10 0 
0,0 1 

0 0 1 

1 . 1 -1 

10 0 

1 1 ' 1 ■ 

1 1 ,f. 1 


' 1 1 ■ 1 

Oil 

0 0 1 
0 0 0 

\ 


Step^ 1 


step 2 Step k ' Step 3 


step 5 

4 



Note. A three-dimensional plenum of tTt^ea variables vas 

constructed in Step i. Its -one dimension, recorded 
in Step 5i vas extracted in Steps, 2, 3i ancl ^• 
(Taken from Kxus, 197^, p. 46.) 



It 



l-truth, 0-false schema. This plenum of response patterns can be seen 
to be reduced to a G^ttman ocale (j^ttman, 19^U) in step 5. Thig^ 
scale- has the property of separating the indflvidual response patterns 
into a unidiinensionaiSOTderin^^ 
I There are many d^ffe^i^nt methods to logically searc^plTor rela- 

'tionships within a given data set. Each logical relation, ip turn, . 
offers a rationale of inferences or non-inferences that'may have theo- 

'y 

retical merit. Within this system of logical constants, various^ 
interrelations resulting from logical connectives such as "and^" "if 
and only if," "either/or" may be scrutinized. Appropriate utilization 
of these types of logical implications .results in ordered hierarchies 
or. unidlmensiooal components'* The implicative functions which lead to 
these ordeJed hierarchies, thei", may be seen as the crux of the 
dimensionality issue. , . 

The implicative functions (Table 2) are: (l) (-) "is a pre- 
requisite to," (2) (-) "implies," (3) (V) "is not % prerequisite to," 

4 

and (^).(/) "does not imply." Employing these functions, one can move 
from one function to another by reflecting variables within the 
system. In the binary case, this is simply a matter of creating a 
function's converse. Investigation of what happens when these func- 
tions are interchanged reveals that the {^,0l ot (0,l) changes (which 
indicate a reverse in the direction of implication) are 'variance- 
generative (Krus, 197^, P' 10). This change can also be seen as an ^ 
indicator that information becomes available. Such tuples differ from 
the (l',l) and (0,0) pairs, which are important for defining the 

^ 



Table 2 



Aliorelative Order-dependent Class of Prepositional Functions. 
Used by Order Analysis to Logically^ Search for 
Relationships within a^iven Data Set 





A 


B 


A -«• B 


A ^ B 


'A / B 


A 




1 


i 


• 1 


1 


0 


0 




1 


0 


0 


1 


1 


0 




0 


1 . 


.1 


» . 
0 


0 


» 1 ' 




0 


0 


1 


1 


0 


0 




a 




I 

.b ' 

• 




t ' 


e 


y 

Note. 


* 

Column 


a — Plenum of re spon s e 
^ A and B. ■ . 

t — Implication 


for the two 
% 


arguments. 



c— -Converse of Iniplicatlon 

d — Negative Implication 

e — Converse of Negative InplicatJ^on 



V 
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within^rder^ructure. ' While the (1,1) and (0,0) tuples i^termine ^ 
the order within tl^ already determined structure^ the variance- * 
generative tuples outlite- the structure of a dimension. 

- In the construction of such an implicative logico-mathematical 
sy&tem, variables are not differentially weighted. That is,, np 
attempt is made to optimize or focus upon any one set of relationship^ 
In sucja eases,' the ^ost appropriate logic functions are the 
ti^ implication and its converse. The reason for this is 
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se of ijega- 
that they 

e 



differ only in their (l^O) and (0^1) tuples (as- seen in Table 2). 
i},,0) tuple refers to a confiVmatory respo^ pattern, and the .(0,1) 
tuple to-a (iisconf irmatory respon|Se pattern. Hi'es'e patterns of con- 
firmatory and dlBconf irmatory response tuples have the essential 
property of stioicturing a particular domain of response patterns in a 
logical' manner. 

As shown by Krus (l97^) and Cliff (l975b), the fr^ujuencies of 
negative implication and its converse, computed from the elements of 
.a binary data matrix, may be used to derive a dominance matrix* 
Involved in the creation of the dominance matrix is the comparison o^* 
all possible row/column tuples. The result of all these comparisons 
is a dominance matrix with integer values in its row/column desig- 
nates. These designates represent the frequency of dominaffion of a 
particular row over a particular column. This comparison of all 
possible tuples — yielding a dominaifte matrix of frequencies — is 
identical to the process of matrix multiplication. However, to 
properly compare the appropriate (l,0) and (0,l) types, the matrix 

17^ 



multiplication is performed on the transposed ori^nal data matrix arid 
its logical negation 02* converse. The dominance mai^ix produced from 
this procedure is similar to a correlation or proximity matrix, in the 
same manner e^Cpr^ssed by; Coombs (196^)- These tvo types of matrices, 

^•t. • ' • ' . • ' \ , ^ ■ 

'y^^ver, (iiffer i<x one important respect — the preservation of direc- 
•^oality. . > ^ ■ 

The value of obtaining a matrix of dominance type, rather than 
one proximal in nature, centers around' .the' fact that a. dominance i 
matrix allows^^f^r the preservation of- directionality -between its eie- 
ments \^il^ the'^ proximity matrix does not. The- iidportance Sf ^tbis * 
dist±nction relies upon the fact that causal reI6.tions cannot be . 
appropriately inferred from a x:or relative or proximity type^ solution. , 
Because of the preservation of the directionality in domiilance rela- 
tions, however, the possibilit*^ of^ causal inferences assocfciated with 
the developmental aspects of Guttman scales becomea a reality. 

Difference Relations 

The matrix of magnitudes generated from the multiplication of. 
the transposed data matrix times its cotopiement may be considered a 
dominance* summary across all elements in the original 4ata matrix. 
Uie magnitude in a given cell of the dominance matrix corresponds V? 
the number of. times an element dominates some other element. Concep- 
tually, this magnitude can be thou^t of ^s, the total * number v^gj^ 
relations existing between the two vectors. Those (1,0) changes may 
also ^e thought of as the variance b^ween any row vectors. This 
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def initioj^ of variance is unique, and thus warrants further e'xplaha- 
tion. 

Variance in ordering theory differs from the common psycho- 
metric interpretation (Kru^l9fr^, p. t) . The distinction between the^ 
psychometric notion and -that of tfce order analytic approach lies^ ^ 
within the philosophical distinction between magnitude and quantity 
(cf.' Guilford, 195^^ P- 7i Torgerson^ Pr 26). *This diitinctjx)n 

results from the fact that magnitude can only be defined by logickl 
argument^, e.g., true-false reiations/ thus "excluding any of the 
commonly used quAJjtitative ilumerical indices: The bulging of a^ 
magnitude model- for variance entails a frequency count of the dif - 
ferent true-false logical Testations, This reinterpretatiori of vari- 
ance into magnitudes allows for the- reflection of the existing 
difference relations.* In addition',, it potentieaiy offers several^ 
advantages over the more classical notions. The amount of information 
contained 'in a given matrix, defined^ as- the number of one-zero changes. 



can be directly calculated by simple summing. Compared to the rela- 
tively complex formulation of covariance, such an additive model is 
very appealing. In addition to the previously mentioned order 
analytic asset of preservation of the directionality of. variation 
then, there is also the advantage of simplicity. 

Implication Prerequisite Process i 

« Most psychological data can be arranged in a matrix fciinat, 
e.g., subjects by ij:ems or recponses. Ordering theor^^ttempts to 
identify the latent structures within a data matrix by observing the 
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■ ■ - ^ ■ . ' J 
joint hierarchical relationships- that exist among the items and persons^ 

The underlying process is an attempt to organize and 'evalioate the 

common sti^icture of the data in some systematic jnanner, • Moreover, ,it 

should be noted that the Joint nature of Guttman scales nebessarily* 

implies that given the structure of either persons or. items, the 

remaining one is also determined. For order analysis, the search fioi^ 

uhderlying structure utilizes the observable hierarchical structure 

and bases its operations on those structures upon logical prihciplrt*^- 



i'cal prihciplrt*^-' 

icaJ. "connectives, 
r/or" catr^e seen 




Within the logic system, various li^^iijof logical "connectives 
such as "and," "if and only if," "eitb 
' to have desirable pntfperties vhen^ 
,itogical substratiims, v^This family ^ 

ability to separate data into its com^nent parts. As 
earlier, it can be said to be dimensMn-generative, meaning that these 
functions possess the ability to systematically organize the data into 
independent dimensions. - ' 

The logical connectives that are the axiomatic components of 
the implications (as seen in Tablf 2) are "is a prerequisite to," "is 
not a prefequisite, "implies," and^^ "does not imply." Again, it is . 
possible to move from one of these 'IMp^icative functions to another, 
simp§Ly by reflecting- the variable values within the system. Based on 
this concept uali:::at ion uf reflection, an» understanding of how the 
(1,0) and (0,i)- tuples ^an be generated should take on new meaning. 

By performin^j; a series i^f reflection^, e.g., from "implies" to "do^s ^ 

•J 
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17 

not imply /\ a systemattc set of '^relations are geflirated separately 
across the j&ifferent rows. 

^ ; , 

it is of. initial importance^ of 'course, is the process of 
identification and separation of the existing subsystems befol!% any 
jjiterai§Ll structur .is i^ertaken. To be utilized in this prior case 
are/functions that deal' solely jwith the variance-generative, tuples of 
Xl^Q) and (0,l).. The simplest logic function that 4§ stiitkble for 
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V 



L^ieating' this type of cbang? i!a relation is tliat of negative impli- 



cation and its logical .converse. Upon examination,, it may be seen - 
Lt the only diffei*ence existing b*etween these txiples is the direction 
change:' 1 to 0 or 0 to 1. * The^ name assigned to the (l,0) confirma- 
tpry response patterns is "pterequisit^,'to." The (0,l) change, or' " . 
dlsconfirmatoiy response patterns, is "is not a prerequisite (to. " 
/ U. To summarize, the conditions of asymmetry, transivity, and 

connectiveness are the foundation of ordering and produce the com- 
posite def ii^itiJi^of axT'order relation. The conceptual product of 
'asymmetry and transitivity conditioiisife the necessary higher-order 
' noti"^ of connectivity. When relatlons/ltre transitive in nature, 

connectivity between the first and last elements in a hierarchy is 

^ • J' ' 

*■ 

. , irflplied. This property, upon#\^ich th^ notion pf prerequisites is 
basid, is the essence of a' simple order which ultimately resjilts in a 
unidimensional construct. Wi^thin a given data matrix, a set of these 
simple orders is said to exist. ^Therefore, uncovering these latent 
uj^idimensional structures involVes the identification of the simple 
orders which in turn define dimensionality. Given a data matrix, the 
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dimensions as QomTltyl.yCTgrined are the development of a set' of oi:ders 

(Russell/ 1919, p. 29). 

^ ■ * ._ 

Order Analysis; An Overviev. . ' : 

' Order analysis, the prototype measurement iqdel of ordering 

theory due primarily to lurus and Bart (1973)^ begins by generating an 

item dominance matrix which indicates the frequencj^ of both the (l,0) 

construct 



I 



and (0^1) item response patterns. The construct idh of th^edominance' 
matrtx, N/ fjj|pm the person by item response matrix S^d\ts trans- 
posed complement, S*, may be represented as: j ' 

• N = ^' S ' U) 

y V ■ , ■ ■ 

>^ere cm element n, . is equal to the number of persons vho get k 
and j/ight, wt^ich is to say/ the numbgr of times itenf k domimtes ixem 
J^. Tims, element represents the number of (0,l) discoof irmatory 

response pal^erns while its symmetric counterpart, n., , represents the 

■* « 

number of confirmatory or (1,0) response patterns. This matrix^ 
'multiplication yields a squar4 matrix of integer values indicating, as 
stated before, the number of times a row element dominat^ a <)f)rres- 
ponding column element. As in a\correlation matrix, measurement error 
may also infiltrate the dominanceV^trix, in the form of intransitivi- 
ties. To take this uncertainty into account, order analysis .utilize 



i 



a probabilistic algorithm designed to measure the relative pureness of 
each particular pair ^of dominance relations. This is don^ by the con- 
struction of a z-ratib (McNemar, •19^7) between the symmetric entries 



<jV the cls:^minancc matrix. In efrect, thic z^-i-atio mca::iuroG^ the de^e 
or dominance 'that exists between twq items V;y the fomula: 

: Tlie probabilistic 'interpretation of dominance matrices is 

V 

cased aoun the assiunpt ion^'of equiprobability between the synimetric 

' ^ • \ ^ ■ . - . I 

counterparts in a dominance matrix. A z is calculated for each 

symmetric pair as well as z^y with each value bein^^ piq,ced on its 



appropriate side>of the difitgonal^ whei^ tl^ n and n . components of 
the ferula are the magnitudes contained in the original dominance 
matrix. For exajnple^ where n.. = 7 and n, . = 2^ the existence of this 
apparent intransitivity can be evaluated by the z^-test. 



z- = = 1.67 

^ . v/7 + 2 



is apparent ITom the /Constant sum in xhe dchonjinator, the symmetric 
entries in the Z-matrix are identical except for their signs, thus \ .- 
-1.67- Though no. direct evaluation is undertaken at this point, an 
obvious interpretation of th^ transitive strength between two items, . 
in probabilistic terms, is possible. 

By the constructioft of the Z-matrix comprising; all possible 
relationships, the selection of a cutoff criterion ^-value (here 
termed z--level) can then be implemented to consider only those rela- 
tionships greater than or equal to a given strength. The ^'s below 
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the desi/jriaLcd in i n i iQiiin criterion 2-level, not bein^^ strong encJu^^h' to 
warrarit considerat lur^ are set to "0/* while f-or the relations greater 
than or ^equai co th(? z-level criterion, a "1" is placed in -the binary 
matrix, Thus, the creation of the manifest or latent structure 
matrix, M, can be represented as: ' 

M ='Z z-ievel . ,(3) 

Of importance is •'that a l<;^can never be placed in symmetric elements of 
the M-matrix because of the sign reversal in the symmetric entries of 
the Zj-tnatrix, thus M contains "tio intransitlv Lties, / . 

The extraction of the implicative^ chains from the binary mani- 
fest structure i/atrix, M, alsol involves what can be consid^ed a 
probabilistii? approach. The procedure begins with both a row and- 



column reordering of matrix M, on the basis of the tember of "I's" 



or 



tran"sitiv^lominanceG. Once reordered, an implic^ttion chain of pre- 
requisites is extracted slating with the first item and searching for 
the closest item that it dominates (is prerequisite to). Thus, the 
extraction process beginning with the first "l" in the first row is 

-I 

undertaken. . ^ N 

'I 

For clarity of description, tbis procedural overview cEoncerns 
itself with the extraction of fitem, chains," though the use of person 
dominance matrix yielding person chaiiJ^^s an equally viable alterna- 
tive.' GiVen, say, that^ltem one dominates item three, they are com- 
bined into the first chain. The same procedure of looking for the ' . 

V 

closest iteiii (in terms of total dominances) that item three dominates, 

2t 
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and so op, is continued until the last item added has no dominances. 

With the inclusioii" of each item in tbe chain, the. entire row and column 

of remaining dominsinees fo^ that item are set tc zerp, thus not'^allgt?- 

ing it to be used in ©thei^ chains% The yet unused items are reordered,' 

and the search for prerequisite domin^ations coh'fflliPues until all ite^ms 

* ■. * . 

have .been placed into a chain. The prpbabilistic nature of this 

procedure is founded in the assumption that an optimum solution con-' 
sists of both the minimum number of chains to account Vf or all the items 
and, more import^ntiy, that the most appropriate grouping of items will 
emerge. Obviously, this need not and, because of the lack of any 
internal restrictions aimed at optimizing these relationships, probably 
will ^pt occur, ' However, bejEloi;^^hese shortcomings of the probabilis- 
tic order analysis mode-^ are elaborated more fully, the description of 
the model in its entirety will firstr be presented. 

Having extracted the implicative non-ov^l&pping item chains 
representative of . underlying Guttman scales, the total number of person 
dominances accounted for -by each' chain are calculated, ThQ person 
dominance matrix, for chain v can be calculated by: ' ^. ■ 



X = S S' . (Jf) 

V V V : 



where S is the submatrix of persons, by the items in chain v. An ele- 

ment, x,^, is the person dominance matrix, X , contains the number oJT 
^ — ih' ' — v 

times person i. dominates person h, i.e., the number of items in this 
reduced set that persoa i^ dominates that h does not. ^ 

The intrant: itivities that exist when the items in the chain do 
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not form a simplex 'makes it .misleading .to simply calculite the rowwise 
marginals of 1^. To adjust for th^e intransitivitfts, 'the z-test is 
performed pn the pers«)n dominance matrix, 'creating again a total'ly ^ 
tr^A^itive. binary dominance matrix, .My- ' '^'^ scalal;' notation" of (5) 
denotes that the. i)i element of^tbe ' .. ' ^ ** - ' ■ ' 



^iliv ^iv 



{ 



person' dominance- matrix X , is converted to z values in JUatfix Z . 

And (6) represents the Ipgical conroarison of all z,, s to z-level, - 

J ' — ihv , — 

thereby yielding the transitive dominance matrix, M . 

M == Z S z-level . . ■ ' " (6) 



The total number of dominances ar^ calculated (7) for each 
ace 



person and are placed in an order loading matrix, L 

:. 'S^ . . ' ' ., /, -.V 



L = I'M y (7) 

. V V * 



Bius, an in^^eger value for eacji per^n equalling the nxombeipof persons 
dominated for a ^^en chain of items re pre s.enting a dimension is 
calculated. In^f actor analytic terminology, the matrix of order load- 
ings is analogous to factor scores, ^>rilile ^he row marginalt; are com- 
tounalities. It is this ^similarity that prompts the rqtation to simple 
structure of the order loefeing matrix (Krus, 1975 ^^p^ 6O-6I) 



Order Analysis: A Logical Paradox j 

^ ' A hypothetical example utilizing the six -person ify nine item 
' response matrix seen in Figure h will be solved for its i2ziplica4H.ve 
xiiairis using'the probabilistic prder analysis method. This exercise 
should both clarify th^ procedural steps as well as demonstrate the 
inherent shortcomings of this approach. Having pointed out tbe draw-, 
backs relative to order €U3alysis, suggestions upon which alternative 

.. ■ J 

methodology may be based will be presented. jjp 

* In the first step, the constru^ion of the item dominance 
matrix (N) in order analysis, is denoted 

N = S'S (1) 

« 

where S is the hyi>othetical six person by' nine it^ response matrix- 
The indicated matrix multiplicative results in the square matrix of 
order six, with integer values in its n elements. As suggested, order 
analysis asBunes that , the counter dominanees appeaz^ln^- in the domi- 
nance matrix, prelented in Table 3, axe merely a fundtion of error. 
•Hie procediire ft)r probabilistically evaluating these intransitive 
errorful relations, McNemar's. (I9't7) z-test, is performed;, 



z 



= ' i^ ; J ^ k (2) 



AL^^'s (Table k) are then compared to the tolerance criterion, in 
this case, z- level = 1.0. For the z values exceeding the criteria 
z-level, a'*'l" is placed in the manifest structure matrix, M, theo- 
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Items 





A 


B 


c 


D 




F 


1 




0 


0 


0 


0 


0 


2 


1 


1 


0 


0 


0 


0 


3 


■ 1 


1 


1 


1 


0 


0 


k 


1 


1 


0 


0 


1 


1 


5 


1 


0 


0 


0 


l' 


0 


6 


0 


0 


0 . 


0 


0 . 


0 


7 


0 


1 




1 


1 


0 


8 


0 


1 


1 


1 


0 


0^ 


9 


0 


1 


1 


0 


0 


.0 



ii 



Figure Binary data mtrlx representing nine 
person rehouse patterns on six items. 
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A 
B 

C 

, D 
E 
F 



/ ; 



Note. 



A 

0 

3 
3 
2 
1 
0 



Table 3 



Item Dominance Matrix N 



B 
2 
0 
0 
0 
1 
0 



c 
1^ 

2 
0 
0 
2 
1 



D 
1^ 

3 
1 
0 
2 
1 



E 
3 

3 
2 

i. 

0 



F 
1^ 

5 

3 
2 
0 



Calculated by premultiplying the trans- 
posed coziiplei&ent of the original data 
matrix by the original data matrix. 
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Table k 
Z-matrlx 





A 


fi 


C 


D 


E 


p 




0 




.378 


.816 


^ ) 


2 




Ml 


0 


l.lfl 


1.73 


1.3^ 


2.2lf 


c 


-.378 


-l.lfl 


0 


1 




1.31^ 


D 


-.816 


-1.73 


-1 


0 


0 


1 / 


B 


• -1 


-l.3»^ 




0 


0 


l.lfl 


F 


-2 


-2.2k 




-1 


-l.lfl 


0 



Note* Matrix of z values calculated from item daninance 
natrix. 
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' reti caliy representing the "true" dominance. The binary M matrix 

^ ■ '" ' V 

appears in Table 5'-' 

A ' ' ' 

^ ' M = Z a ^z-level = (i.O)j . (3) 

J Bie assumptions and procedures presented to this point, de- 
signed to isolate .Jjbe latent dimensions, appear reasonable, yet on 
closer inspection dre. paradoxical. The assumption that counter domi- 

nance or intransivities are sla^ly brought about by errbf is clearly ^ 

t 

antithetical to the issue of multidimensionstlity . For counter domi- 
nance could actuaJJ^y represent the existence of multiple factors 
within the data unless, of course^ the data are sin^jly uni dimensional. 
The paradox, obviously, is that by cancelling out the effect of the 
counter dominance ih the multidimensional case secondary factors are 
obscured, leaving only a primaiy first factor. Order analysis by 
restricting its definition of dominanoe limits itself to -the considera- 
tion of the most prominent unidimensional scale.' This apparent break?- 
down at the basis of the or^er analytic npthod warrants a rethinking 
of the entire conceptualization of multidlmensionality specific to a 
dominance matrix context. However, the further elaboration of ot6er 
related procedural flaws will also be* of considerable value, particu- 
larly in the consideration of an alternative procedure. 

Given the manifest structure matrix, the next step of the 
order analysis procedure is the extraction of the dimensional' chains. 
This process begins with the reordering, of rows and columns of the M 
matrix, from most dominances to least^ as has already been seen in 

31 



Table 5 
Manifest Structvire Matrix M 





B 


c ' 


A 


. D 


E 


F 


B 


0 


1 


0 


1 


1 


1 


C 


0 r 


0 


0 


1^ 


0 


1 


A 


0 


0 


0 


6 


J - ■ 


1 


D 


0 


0 


0 


0 


0 

« 


1. 


E 


0 


0 


0 


0 


0 


1 


F 


0 ' 


0 


0 


0 


0 


0 



Note . Reordered manifest structure matrix, 
14, using a z-level = 1.0. 
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Table 5. Commencing with the first row, the extraction procedure 
searches for the first 1, representative of the coimection between the 
respective elements. . In this example, item B domifttes or is p:|:^eq- 
uisite to item C. Then item C dominates item and item D dom i nates 
item completing the hierarchy of the first chain. Thus, the 'chain 
of connections B C D F created by the pairwise relations between 
the; adjacent items in the chain defines the first unidimensional struc- 
ture. Having completed the chain, the remaining relations of its 
member items are deleted. The construction of the next chain then is 
approached in an identical manner. In the present, example, this 
yields the A E chain. As all items are accounted for, a two- 
dimensional solution emerges. 

^ Examination of this type of extraction procedure reveals two 
separate but related theoretical flaws. First, it^ can easily be seen 
that such a procedure does not guarantee that all chains pre,sent in 
the M matrix are extracted. While the present*' example is not large 
enough to give a clearer illustration of this, the existence of iihe 
B E F and A E F chains 'does suggest this possibility. Once 
the existence of other ci>ains is ackno\S^le<^ed, however, a more * 
important question arises: Have the optimal ch^iins been selected?^ 
Optimal, in this context, may refer to> a n^ber of criteria, suc6 a^jST* 
the longest, the most Guttman-like, or the most orthogonal set ol 
chains. In any case, the failure of the procedure to systematically 

r J 

Consider any of these criterion standards seriously reflects on J^s 
credibility. 33 ^ 



The second shortcoming of the extractitjn procedure is related 
to the broader issue of intradimension cons,i^tency and may be gleaned 
from Figure 5- '1^ this figure, a simple reordering of the items in > 
the submatrix of chains I and II reveals that one inconsistent relation 
exists in each chain. For chain I, item F for /person 5 is not, con- 
sistent, and similarly for chain II, person 7's correct response to 
item E is' inconsistent. Because of the lack of any goodness-of-f it ^ 
statistics measuring the chains' consistency relative to the perfect 
slinple^x, a potential user of. 'this procedure cannot colirpare solutions 
at different levels of internal consistency. Obviously, such goodness- 
of -fit indices are. crucial to suay soundly based measurement procedure. 
Further, any descriptive statistic developed with this purpose in mind 
must be comparable to other measures of dimension construction, the , 
most common being measures of variance. 

Having already selected the chains, the next step in order 
analysis is to obtaini^rder loadings for persons on each item chain. 
On a given chain of items, the person-prder loadings represent the* 
number of persons that a particular individual has consistently out- 
scored, i ♦ 



fee method for obtaining the order loading matrix begins with 
V the calculation of a person dominance matrix, 2^^, from the submatrix 
of items,* S , from chain v. 

X = S S' ^ 

V V V 
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3 ^1 '110, If 1 .1 

T 1 .1 1 0 . 5 1 '1 

81110 -110 

911 0 0 210 

^rson k 1 0 0 1* Person 3 1 0 

21000 701 

10000 ■ 600 



50000 , 800 

600 0 0 900 



Figure 5. Reordered hypothetical data matrix. 

Persons reordered within chains to 
-illustrate the inconsistent responses, 
which are underlined. 
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As before, a z-test is performed on the symmetric elements, x. .v' 

the dominance matrix. This tijne, however, it is person dominance^ 

. P 

rather than item dominances which are sought* 

^ihv " \iV . y . / V 

' ihv niv 



This Z-matrix is then conpared to thfj£-level criterion value, which 
remains the same as the first test's z-leyjfel = 1.0 • 



Mi z-level = (l.O) ^ (6) 

- » V 

The ;resulting matrix, M, of transitive person dominance is svmamed and 
the marginal totals represent the 

L = I'M , (7) 

• V V r 

nionber of persons an individual dominates. The earlier mention of 
consistent wins refers to a consistency inferred through use of the 
2-test. The order loading matrix, L, constructed for the two chains 
is presented in Table 6. Again, the integer values are interpreted as 
the number of persons that a particular individual outscored, sgiven the 
consisttot items he got correct • To complete the description of order 
analysis, the matrix of order loadings "is standardized by converting 
the integer loadings intJ proportions, and then rotated to simple 
structure by varimax (Kaiser, 1958) • 

Though no extensive criterion of the person dominance inter- 
pretation of order loadings will be presented here, the methodology • 
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Table 6 
Order Loading Matrix 0 





CHAIN I 


CHAIN II 


B 


- C 


-► D .-► P 


A - E 




1 


0 


3 




2 


3 


3 


CD 


3 


5 ' 


3 


a 

o 

(0 


k 


k 


7 


u 

V 


5 


0 


7 












6 


0 


0 




7 


5 


3 




8 


5 


6 ° 




9 


^ k 


"0 






♦ 





Ixnplicative chains extracted from reordered 
manifest structure matrix with order load- 
ings constructed using second z^-level= -1-0 
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upon which it is based is nonetheless subject to question (e.g., the 

£-test criterion) . And if the extracted chains represent unidiiuen-^ 

sional scales underlying the data matrix, the- need for rotation is ■ 

unclear. Given the serious procedural, shortcomings that have been 

discussed already, rotation may be nothing more than an attempt to 

sift throiigh the structure in search of meaning. Any prpce<iure that 

Identifies the true unidimensionsi^ components, as order analysis pur- 

ports *to do, should have no need for rotation. . , . 

In sixmmary, an example of the probabilistic vjerslon of or^er 

analysis has been traced throu^, nlking its procedural shorjiccaiings. 

Two problems emerge that, if resolved, could lead to a theoretically ^ 

sound procedLire for the extraction of multiple Guttman scales. First, 

the internal consistency of all elements in a rather than Just 

Its adjacent members, is crucial. A solution to this problem would. 

In effect, also resolve the logical parado3j of/ multidimensional 

counter dominances or intransivities. Internal consistency redefines 

the multidimensionality of the dominance matrix, allowing- for an 

appropriate appraisal of the existing countei;, dominance. The second 

problem involves the development of standard procedures for selecting 

-3 

the optimal chains. Necessary to the selection of the optimal chains. 



however, is the consideration of all chains. Thus^ the factor extrac- 
tion methodblogy must first extract all chains before the selecpi^on 
procedure can be implemented. .* . ' ^ 

-^8 « ^ 
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MODEL AND THEORETICAL OCTISTRUCTS 



ERGO; A Procedure foM Extracting 
Reliable G^ittman Prdej^^s 

' * An- alt emativej^ approach that avoids the pitfalls of order 
analysis must redefine internal consistency In terms of ;Lts coxipter- 
part in classical test theory reliability. Cliff (l975b^ suggests a 
series of -indices, intended for a testing context, that establish a 
relation between dominance matrices and classical measurement,,^ Among 
the indices' described by Cliff (1975^)) is a measure of internal con- 
sistency calculated from a dominance matrix that fxinetionfe lik? the^ 
standard Kuder-Richardson formulae (KR) (1937)» In conjunction with " 
a methodology for defining an optimal, representative set of factors, 
the application of internal consistency presented by Cliff will be 
utilized in "a new model termed ERGO. This alternative model attempts 
, to resolve the paradoxes common to order analysis, while still associ- 
ating itself with certain elements of ordering theory. 

. Internal Consistency 

The index proposed by Cliff 1975b) is based upon two param- 
eters and yields a numerical value which represents the internal 
consistency of a set of dominance relations. The first parameter is 
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the relation of an obtained dominance matrik to a perfect Guttman 

• % 

simplex, and the second parameter is the relation of an obtained^ 
dcxninance matrix to a theoretically random set of dominances, pefore 
the assumptions underlying the development * of the index are presented^ 
it should be noted that the identical operations hold for both person 
or item dominance matrices. However, tp be illustratively consistent 
with the preceding example,^ the item dominance matrix> wiJ-1 be used. 

. Given the item dominance matrix the total number of rela- 
tions, U; is denoted in eqioation o.. > 



The matrix notation for this summation, when S is the binary response-^^'-' 



matrix and (SS') its dominancV mat^x, is seen ^in^ equation 9- 

•.u = i»(s's)i ' . (9) 



If the rows and columns ,of the item dominance matrix are reordered in 
a descending fashion and the data are perfectly consistent, all the^ 
.^j^ipaApe,.3:ela.tions will,b^_cpflt^l,Q§d,in t^e upper .triangle.. '^m^^.tQX.S^ 
perfectly consistent data the number of dom1 naffe^s in the upper 
angle, u^, would equal the total, u. 

u^= Z Z n ' ' (io)-^ 

By eqioating perfectly consistent with Guttman simplex, incon- 

\ - ' 

siatency can thus be evaluated iii^erms of dominances that fall below 
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the upper triangular portion of the reordered dominance matrix. To 
put these relationships into a pro^r perspective, however, the con- 
Sideratioa of a second parameter, a probabilistic distribution of 
dominances, must al3o be considered* 

The assumption of no order, in the context of a dominance 
patrix, necessarily suggests an equal number of dominances for each 



^Jk* ^ case of equally distributed dominances, n^^ and can 
be vieved as both estimates of the saioe quantity, v., • Ibus, it fol- 
lows that by averaging the symmetric entries an expectedWlnimum, u , 

1 

is produced. ^ 
t 

Distributing the sums, a maximum of ^u is realized. 



= U - *Ui 

m ^ 



(12) 



Thus, a consistency index, c, relating the actual number of dominances 

in the upper triangulex portion to that expected by chance, can be 

constructed. A one is subtracted from the upper triangular "goo<^ 

dcminance-to-chance proportion In order to distribute the consistency 

value frcm 1 thereby yielding 

ft 

c = ^^l^ (13) 

^ ^ 

*■ < 
By simply ridding the denominator of the fraction 

2u 

^ _ m ^ ^ 

u 
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we have Clifr's index oV item consicteacy, c. By eissentially the same 
rationale, Cliff ( 1975b) redefines the Kuier-Richardson formulae 
(19:57) ana the Loevinger index (l9^7) by considering^ the obtained 
upper trian^^ar dominance, the maximum possible atuuber of dominances, 
and those expected by chance. The foundation of the consistency 
index, considering its utilization of the same parameter that under- 
lies such classical reliability coefficients as KE20 aiid KR21, makes 



it a most appropriate alternative for evaluating order consJ^iCency 
over the entire dominance matrix. What remains, having established the 
suitability of c, is the methodology through which it may be imple- 
mentecX. 

Selectinc Qptim:il Chaina, ; ^ 
Internal Procedure 

Optimal chains employ both internal (within chains) and 

external (among chains) procedures that are directed toward selec\ing 

the most appropriate set of item combinations to represent the data. 

With the restriction that consistency across all member items remains 

as high as possible, the internal procedur^ concerns itself with the' 

chaining uf certain items. This contrasts with the order analysis . 

procedure that operationalizes the chaining by considering only the 

adjacent cormectionc. Once the unidLiicnsional chains are constructed, 

the external optimization procedures attempt to order the chains in 

tenr.G ci *.heLr relative coritriLution in explain Lnc the dLnensionality 

of the uata structure. Necocsarily, the evaluation of relative con- 

tritutiv ns^acroGo chain:; ha^ as a prerequisxte tht- r^xtracticr. of all 

cha i ns . 42 ^ 
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Th^ initial consideration, viz,, the combining of items into 

chains, involves an iterative approach. For a given item chain, the 

most consistent item as determined by the highest consistency, c^, 

vhere £ represents the joint subset of items, is joined to the initial 

chain. If a tie in consistencies exists, the item closest, in terms 

of difficulty level, is given priority. Thus, for each item, k, a 

consistency is C3alculated, c , , combining the new item with the 

1^ ^ ic 

items already in the chain, ^ 

<^p. = + k ^^^^ 

Hie iterative procedure of sequentially adding items to chains on the 
basis of the overall consistency of the chain is operatiooalized for 
all items by allowing each item to initialize its ovtl chain. In 
matrix terms, the rows become representative of chains while the > ' 
columns remain representative of items, Ttie entries of the final 
consistency matrix, F, correspond to the consistency level at which the 
item, J^, was added to the chain, 1. kn illustration of this procedure 

1 

for the hypothetical example presented previously is seen in Table 7- 
To identify member items, an elemerit-by-element comparison of 
matrix F is made to a subjectively determined consistency cutoff value, 
cv. For example, by setting cv at any value greater than .84, i:he 

resulting binary membership matrix, B, is produced (see Table 8). ^ 

«■ ' ' 

B = F J cv 

43 
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Table 7 • 

m 

Final Consistency Matrix £ - 
Items 





B 


A 

*- 


C 


D 


E 


p 


I 


1.000 


.516 


1.000 


1.000 


.611 


.800 


II 


.680 


1.000 




.571 


.800 


1.000 


III 


1.000 


..516 


l.QOO 


1.000 


.611 


.800 


IV 


1.000 


.516 


1.000 


1.000 


.611 


.800 


V 


.833 


.680 


.516 


.571 


1.000 


1.000 


VI 


.833 


.680 


.516 


.571 


1.000 


1.000 



Note * Rows represent chains and entries in reordered 
columns represent consistency at which item 
was added to chain i. 
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Table 8 

Binary Item Membership Matt-lx B 

ItenL 







B 


' A 


c 


D 


E 


F 




i\ 


1 


0 


1 


1 


0 






11 


^ 0 


1 


0 


0 


0 


1 


a 


111 


1 


0 


' 1 


1 


0 


0 


e 


IV 


1 


0 


1 


1 


0 


0 




V 


0 


0 


0 


0 


1 


1 




VI 


0 


0 


0 


0 


1 


1 



Note , Binary item membership matrix, B, resulting 
from any consistency cut off value > .84, 
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0 . 

Removing the duplication, three chains are revealed, namely, 
B - C - D (I), A - F (II), and E - F*(lllj*. Be^^pse each chain h»s a 

' "r. 

consistency value of one, as may be seen in Table J, there are no 
inconsistent relations, Fi^re 6 breaks down the chains into their 
respective submatrices^ confirming the existing simplex for each chain. 

Having completed the outline of procedures ihvolved with' 
internal consistency, the procedures utilized in evaluating the con- ' 
tributions of the extracted chains will be presented. However, before 
the details of the considerations used in evaluation are brought forth, 
the scoring procedure implemented in ERGO needs to be discussed. In- 
stead of defining scores as person ddminsjice as is done in order 
analysis, £ straightf orwafc siimmary of consistent relations (see 
Figure 6) for an individual for a s^en chain defines score. The 
redefinition of score using marginal sums offers a convenience of 
V interpretation which will be demonstrated in the empirical example to 
be presented later. 

Selecting Optimal Chains ; * 
External Procedure 

The decision concerning the optimal , solution and ordering of 
chains, like the ordering of factors? .in factor analysis (FA) or dimen- 
sions in multidimensional scaling (MDS), must be related to the overall 
epistemic contribution of tAe dimensions. ^However, the distinction 
between the stioicture of the dimensions recovered with the ERGO 

i 

procedure and those from either FA or MDS requires a redefining of 
contribution.^ With FA and MDS, the variables or stimuli are assigned 




B 


- c 


- D 




A 


(3) 1 


1 


1 


3 


(If) 1 


(7) 1 


1 


1 


3 


(1) 1 


(8) 1 


1 


1 


3 


(2)*! 


(9xri 


1 


0 


2 


(3) 1 


(2) 1 


0 


0 


1 


(5) 1 


(U) 1 


0 


0 


1 


(6) 0 


(1) 0 


0 


0 


0 


(7) 0 


(5> 0 


0 


0 


0 


(8) 0 


(6) 0 


0 


0 


0 


(9) 0 



II 






IV 




P 


(2) 


E 


- F 




1 


2 


ik) 1 


1 


2 


0 


1 


(5) * 


0 


1 


0 


1 


(7) 1 


0 


1 


0 


¥ 


(1) 0 


0 


0 


0 


1 


(2) 0 


0 


0 












0 


0 


(3) 0 


0 


Q 


0 


0 


(6) 0 


0 


0 


0 


0 


(8) 0 


0 


0 


0 


0 


(9) 0 


0 


0 



Figure 6. Reordered data for ERGO solution. Extraction of 
three chains from hypothetical data as determined 
by ERGO prtDcedure. Person numbertf^n parentheses. 
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weights on all factors or dimensions^ but in ERGO weights are assi^ed 
to dimensions which are' actually composed of subsets of items. Thus, 
a procedure for optimally combining the diroensional chains to account 
for the maximum nymber of items appears reasonable. When additional 
chains are being considered for selection, the maximum number of items 
refer^ to unique, or yet unaccounted for, items, 

A procedure for ordering the extracted chains im terms of their 
maximum number of unique items added appears straightforward, €ompli- 
cations from ties arise, however, making additional considerations 
necessary. For a* given set of chains, the selection. procedure first 
calculates for each pair of chains the total number of unique items. 
Given that one such pair of chains has more than any other^ the selec- 
tion is greatly simplified. The chain containing the most items is 
put first, the remaining chain second, with additional chains being 
added corresponding to their number of unique (yet unaccounted for) ^ 
Items, In the case of a tie of unique items, the chain having the 
-leas^ overlap (items in cojamion) with the already accounted for Items 
is chosen. When pairs of pairs are tied in both number of unique soad 
number of overlapping items, a still different procedure is called for. 
This is to take the pair of chains that, within the pair, demonstrates 
the largest difference in terms of their resulting orders (person 
orders). The largest difference is defined as the largest nuiqber of 
inversions in their corresponding person orders. To amplify, a single 
inversion in order exists between any pair when, say, aRb in one rank- 
ing is compare^ to bRa in the other. Thus, by totalling the number of 
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inversions and the number of agreements and then adjust i/ig for the 
number of possible agreements, an index reflecting the degree of dis- 
, sirjolarity of the two orders is developed. The index suggested paral- 
lel^ the procedure utilized in the calculating of Kendall *s tau a 
(Kendall, I962). It differs, however, in that the most appropriat^ 
selection (having the most inversions) is the lowest tau value, as tau 
is a measure of agreement rather than disagreement. 

To best illustrate the process by which chains are ordered, the 
hypothetical example will again be referred to, beginning with the item 
membership matrix, B. Chains III, . IV, and VI in matrix B will be 
removed because of their obvious redundancy, leaving for consider;^tion 
chains I, II, and V. The heuristics upon which the subsequent chain 
selection procedures rely are founded in Boolean arithmetic, briefly 
summarized heie; 

0-K)-0; 0+1=1; 1+1=1; 1x1=1; 1x0=0; 0x0=0 

> 

A summary of unique items between chains and ^ is computed 
from the B matrix and placed in the appropriate upper triangular ij 
element of matrix 0 (see Table 9) • Thus, ^ 



o. . = Z Z (b. + b.) (16) 

iJ i j>i 1 J • 



where "+." indicates Boolean arithmetic, and b. and b. represent rows 

i J I 

corresponding to chains in the nonredundant item membership matrix B. 
The lower triangular elements of matrix 0 are the number of over- 
lapping items between chai^p £ and chain ^ denoted as 



(0 

a 



II 



Table 9 ^ 
Matrix 0 

Chains 
I II V 

5 5 



Upper triangular portion summarizing all paii 
vise uniquenesses vhile lower triangular 
portion summarizes the pairwise overlap. 
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where x again indicates Boolean arithmetic. 

Insi)ection of Table 9 reveals that chain I is tied with chain 
II emd chain V with five unique items w The overlap criterion cannot # 
break the tie, a^ neither chain has euiy elements in common with chain 
I. .In this case, the next step is the correlating of the person scores 
derived from their respective chains (I with II and I with V; so as to 
determine the most dissimilar pair. The resulting tau0 as seen in the . 
upper^halfdf Table 10 are -.139 and .0278, respectively. On this 
basis, the I-II pair is selected. Having not accounted for all the 
items (viz., item E), chain V is added, resulting in the final order of 
I, II, and V. , * • 

■ * ■ ' 

Other situations not represented in thi's example need to be 
mentioned. First, given that all items are accoiinted fqr, any remain- 
ing chains are dropped. Second, the converse situation, where addi- 
tional> chains add only a relatively small number of items, thereby 
having little substantive value, suggests the implementing ol a scree- 
type procedure^ to discount the smaller chains. And third, where an 
attempt for orthogonality of ^covered dimensions is desired, the 
removal of items contained in more than one chain is suggested- To 
allow for the evaluation of the above mentioned considerations, a 
summary matrix for each solution as is seen in Table 6 is constructed. 
The values in the upper triangular portion, as already i^entioned, refer 
to the taus between chains. The values in the lower triangular portion 



Table 10 
ERGO Sunnnary Matrix 



Chains 

I II V 

3 /-.■139'. -0278 



a 



II -.139 " 2 .389 

V -.0278 .611 1 



Note . Summary matrix with tau a values in upper triangular 
portion, tau a discounting aJ.1 overlapping elements 
in lower triaxigular portion, and number unique items 
added by that chain in diagonal . 



k9 

refer to the tau correlations discounting common items, and the 
integer values in\the diagonal denote the number of unique elements 
added to the solution by the inclusion of that chain. ^ 

In summary, having an index that corresponds directly to such 
classical indices as the Kuder-Richaj:nison formulae (1957) like the 
internal consistency in^ex proposed by Cliff (l975b) provides an unam- 
biguous procedure for combinin^g items into chains. One possible im- 
provement, however, is a weighting system that adjusts more fully for 
item difficulty, rather than a total reliance on item consietency. 
Unfortunately, the external selection process, not being grovmded in 
Such fundamentally souQieL principles, cannot be 'considered as favorably. 
The shortcomings become manifest as the dimensionality increases, thus 
allowing more chance for an erroneous selection. It may be seen that 
until indices are developed that maximize specific relationships, 
preferably in both the item and person dominance .contexts, the entire . 
extraction procedure may remain suspect. At any rate, a more sophis- 
ticated definition of chains relating directly to the dxoality that 
exists between item and person dominances is definitely called for. At 
this time, having not resolved this issue, the selection procedures as 
described will be implemented- in the dimensionalizing of an empirically 
derived data matrix. 



AN EMPIEICAL EXAMPLE 
Method 

• " To. demonstrate the order extracting procedure in a practical 
context, aji investigation was designed to allow for maximum empirical 
validation. Selected as a representative, well-known Guttman scale was* 

* Sr. , 

/ 

a Bogardus-type social distance scale (Bogardus, 1925 ). A question- 
naire was constructed that incorporated seven social distance items in 
a binary choice format (see Appendix). All of these were then paired 
with three ethnic groups: Black, Mexican-American, and Oriental. By 
having members of the three ethnic minority groups, in additioii to 
Anglos, responding tc^he questionnaire, it was fe;.t that the ordering 
of the items would not only group together it ems^ referring to.the .same 
ethnic group, but would also serve to cluster the individuals with 
regard to ethnic group membership. 

The 21^item social distance questionnaire was administered to 
dh unde-rgraduates at the University of Southern California, who par- 
ticipated in the fulfillment of course requirements. Prior to the 

administration, subjects were asked to consider the general image of 
f 

ethnic groups other than their own. To assure compliajice with this 

•41 

request^ subjects were asked to construct a written outline listing 
\ 

several key descriptors 'of each group. Once thi^ preliminary task was 

■ 50 



completed, the subjects vere instructed to keep in mind the images 
rather, t'han a specific individual when responding to the sociaJ. dis- 
tance items. This vas done to maximize the number of resulting 

response patterns. Of the Qh respondents, 60 gave non-duplicate 

t 

response jjatterjas for the 21 items. Ethnic composition of the 60 
respcmdents was as follows: six Mexican-Americans, eight Blacks, four- 
teen Orientals and thirty-two Anglos. 

Results 

The afominance Tnatrix, final consistency matrix, and reduced 
'chain by item membership matrix calculated at a minimum consistency of 
.95^^ presented in the Appendix. Hie thirteen nonreduhdant chains 
were subjected to the chain selection procedure, which reduced to seven 
the number of chains necessary to account for all the items. The 
reordering of the seven chains followed the previously described pro- 
cedural steps of first maximizing the number of unique items and in 
the case of a tie selecting the chain with the fewest number of over- 
lapping iteays. The summary matrix for the reordered set of seven 
chains containing the number of uni^^ue 3t€ems added in the diagonal as 
well a^to their rank order intercofreJ-ations (see Table ll). 

As suggested, the i%sue of limiting the number of chains or 
dimensions to those considered "significant" is resolved by the appli- 
cation of a Gcree-^ype procedure to the respective number of xinique 
items added; In doing so, the apparent cutoff is the third chain, as 
tHe fourth chain adds only 2 items to the I6 alredhy accounted for by 




Table 11 

Sunmary Matrix for 60 Person by 21 Item Social Distance Data 



^Chains 





X 


XI 


I 


VIII 


XIV 


XVIII 


IX 


X 


7 


.18 


.ih 


.16 


.76 


.70 


.17 


xi 


.20 


5 


.13 


.72 


.18 


.19 


.12 


? 


.12 


.16 


If 


.12 


.Ik 


.22 


.89 


VH 


•17 






2 


* 

.10 


.15 




XiV 




.07 


.21 


.16 ■ 

< 






.16 


XVII 


.^9 




.25 


.26 # 


.53 


1 ' 


.2k 


IX 


^ .18 


.10 


.53 


.3^ 


.U2 


.39 


1 



Note, tau a values between complete item-chains are in upper 
triangular portion. In lower triangular portion are 
tau a values for scores con^iuted from number of unique 
items added by that chain, which appears in the diagonal. 
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the first three chains. The items of which the three chains are com- 
posed are listed in hierarchical order in Table 12. 

Xjis seen in Table 12, the consistency ^tT the ethnic group refer- 
enced within the three chains, with a few exceptions, namely^. items 

i 

and B in chain X and item U in chain XI, is apparent. Chain X is . 
coniposed of items illustrating afi^ social distance scale for Mexican- 
Americans, as are chain XI for^^lacks and chain I for Orientals. Thxxs, 
the correspondence of the three item chains to each of the three ethnic 
groups reflects favorably on the chai|i selection procedtires. However, 
the existence of the exceptions within chains X and XI does not allow 
for a cleax definition of an individual's social distance specific to 
eul ethnic group. ^In an attempt to resolve this' sitxoat ion, the over- 
lapping items, that is, items contained in more than one chain, are 
'eliminated. '-The remaining fourteen unique items (as denoted by an 
asterisk [*] in Table 12) still contain one inconsistent item, item U 
in chain Xl . 

The appropriateness of the resulting solution can be illus- 
trated by compsLTing the recovered hierarchical groupings of items 
(Table 12) to the proposed hypotheti<5al ordering of .social distance 
items. Except, of course, for the one inconsistent item, U, in chain 
XI, the ordering of the unique items within each chain corresponds 
closely with the hypothetical ordering. In fact, the oxily exception 
is the reversal of items 06 an4 07 in chain I. Therefore, aside from 
a few minor flaws, both the homogeneity of scales and the ordering of 
items within scales resulting from the ERGO procedure would appear 
quite reasonable. 
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Table 12 
Items in Chains X, XI, and I 





Hypothet- 


Alphabet- 




Ethnic 




ioal Order 


ical. No. 


Quest4.on 


Group 




(06) 


N. 


Would work in same office . 


Oriental 




(B7) 


B. 


Would have- as speaklxig acquaintances 


Black 




. (M7) 


* *H. 


Would have as speaking acqioaintances 


Mex-Amer 


X 


• 


*C. 


Would work in same office 


Mex-Amer 








Would invite for dinner 


Mex-Amer 








Would have as close friends . 


Mex-Amer 




CMl) 


*J. 


Would marry into group 


Mex-Amer 

o 




,(B7) 


B. . 


Would have as speaking acquaintances 


- Black 




(03) . 


*U. 


Would have as next door neighbors 


Oriental 


g 


(B5) ' 


«F. 


Woulfl! consider as friends 


Black 




(b4) 




Would invite £or dinner 


Black 




(B2) 


*Q. 


Would hav^ as close friends 


Black 




(Bl) 


«M. 


Would marry into groifl? 


Black 




(06) 


N. 


Would worit in same office 


Oriental 




(07) 


«L. 


Would have as speaking acquaintances 


Oriental 


t-l 


(05) 


*0. 


Would consider as friends 


Oriental 






«D. 


Wduld invite for dinner 


Oriental 




(01) 


«K. 


Would marry into group 


Oriental 



Note. Hierarchically ordereci^ items comprising first three dimen- 
sions. Hypothetical ethnic distance coding is in paren- 
theses. Asterisk (*) refers to items contained in only 
one chain. 
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The further evaluation of the ERGO procedure, the clustering of 
individuals into their appropriate ethnic groups, is rea2ized in terms 
of their scores (see Appendix) » As would be expected, every ethnic 
group- member endorsed all the items referring to his group ♦ More 
linportanti however, is the direct correspondence of an individual's » ^ 
score, to his relative position on the unidimensionai constructs, there- 
by permitting §ase of interpretation. This fact, combined with the 
developmentaJ. interpretation stemming from the notion of logical pre- 
requisites underlying Quttman orders, adds further clarity to the sub- 
stantive interpretability of person scores. 

To illustrate, the scores for the first Anglo (l 5 2) can be 
directly interpreted as the subject's social distance relative to the 
three ethnic groups. Thus, the score of 1 for the first chain (X) 
^ composed of the Mexican-American items corresponds to item M7 (would 
have as speaking acquaintsuices) . SimiJ^rly, the score of 5 on the 
chain referring to Blacks (Xl) indicates item B^^ (would invite for 
dinner;, while the score of 2 on the Oriental item chain (l) corres- 
ponds to item 05 (would consider as friends). The encj^ji^sement of the 
items below the score level designated is assumed,^;;^ thereby giving a 
more precise meaning to the scores. The developmental notion of pre- 
^ requisites corresponds to the previously suggested positioning of 

people and items on the same unidimensiortai scale. This dual position- 
ing allows for both persons suid items to be considered in relation to 
each other, yielding an increase in the number of relationships tjjat ^ 
are directly observable. ^ . 
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However, in the case of inconsistency, which appears as the 
endorsement ^i<if^ an item without the endorsement of its prerequisite, • . 
the question of" Vhat score level is most appropMate may be raised. 
In this example., I'b was a^umed that the failujre to positively endorse 

s.i'^r- 

an item prec^luded consideration of other endorsements further along in' 
the hierarchy. This highly simplistic approach to scoring (for these 
psjTticular data) did not suffer from multiple errors, which are de- 
fined as the occurrence of ^hdors^mentSi more, tjiaji one item without 



the necessary endorsemen<t vof some prerecjuisite. , For data involving 

' ^ ; / ^ . \ ■ ^-^ '/ ' . 

JLnstamces where multiple errprs do - exist, more' <OB>*Lstica^e4 .types of 
scoring p4;^eeduT*s invol^siiie probabi^isfe^Lc-'evalixationfof '^h^ .IndiVidu- 

^ ■ . ■ ■ - ■ ' JK' 

al's reapiAsfe pattern need tc^'be developed. ' ■ ' ' w , 

The toverafl evalu§4sion 'g^^ the Tesylts ^.ppears favorablie. .The 



identiSj-cation of hierarchic^ly graded orde^' within the thPree ethnic ' 
groups would verify this. ^In addiftion to'thfe resulting ethnic-item 4. 
TvierarcJ^c;^, thft^oase of :(fitejrpretatidn of person 'scores along the 
recovered ^^fefeh^iic dl^nslons suggests jjLpGO t^be" dViables'l^thod 'f or - * 
recove]?^^_dimensio4i5 inydl!c]3NDtom(^^>;^temsl The imftl^icalii9^s of . , .v 
bining pTer^ns, and, it6ps Qja vtjjQ sanaS* sta^e, tnereby%fermitting the > . ^ 
djlrect evaluation t)f persdh-itejnr re.ittionship^r^present -the' re^arcne 



Vffth m^;Sj; interesting posfcibiiiities, esp^cia):ly' those involving^ 
'•develpfembntal relationcli^^l -rWoreo'^^^ is t hi knowledge. 'of botk 



er 7 



Jihcvperson and ite^ 
impprjt^nce .^^ * 



llatlcrns' that Jias practical a^' weil. as theoretical 



ERiC>: 




A method of factor extraction specific to a binary matrix, 
illustrated here as a person-by-item response matrix, has been pre- 
sented. The extraction procedure, termed ERGO, differs from the more ^ 
commonly implemented dimensionaJLizing techniques, factor analysis and 
multidimensional scaling, by taking into consideration item difficulty. 
Utilized in the ERGO procedure is the calculation of a dcxpinance matrix 
vhich, for either persons or items, has the important attribute of 
allowing directionality to be inferred between relations. 

The theory underlying ERGO is founded in ordering theory 
(Airasian & Bart, 1972), with its interpretation of dominance relations 
following logical implicatives similar to Boolean algebra. The re- 
definition of dimensionality using both the notion of dominance rela- 
tions emd that of logical prerequisites can more aptly be identified 
with the definition of a Guttman order, thereby placing emphasis on the 
developmental aspects of recovered sets of dimensions. It is this 
interpretation that allows for^the duality of relationships between 
persons and items. The resulting placement c£ both persons and items 
on the same unidimensional construct presents the researcher with the 
opportunity to observe direct relations between the two. 

61 " ' 
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^ A prciimlnary attempt to utilize the apparent udvantageG asso^- 
ciated with the extraction procedure based on dominance relations, 
order analysis (Krus, Bart, & Airasian, 1975) is used. This is done 
both to further explicate the implications of ordering theory" as well 
as tq point out the issues with which a dimensionalizing procedure of 
this type must concern itself. "In this discussion, the procedural 
shortcomings of order analysis are presented to acquaint the 'reader 
with the obstacles that an alternative approach must overcome. Pre- 
mier ainong these is the failure of order analysis to consider the true^ 

/ 

nature of multidimensionality in a dominance matrix context. This 
appears in the order an5.1ytic assiunption that counter dominance rela- 
tions are merely a product of error, rather than being manifestations 
of the multidimensional nature of the data. The alternative procedure 
(ergo) is developed by dealing with this essential point. , 

The key to the dimension extraction problem of EEGO rests in 

O 

the formuiatiun of an index of dimension consistency that is comparable 
to classical measures such as the Kuder-Richardson formulae (1937) and 
the Loevincer homogeneity indices (l9^7)- Cliff (l975b), by demon- 
strating thO' relation between these classical indices and their 
redefinition in a dominance matrix context, lays the foundation for the 
dfrvry: upment of an alternative procedure. TliUS, by adopting a consist- 
ency Acj^ure developed there, ERGO iteratively adds items to^jiether, 
ru^uitin^ iri the construction of various sets of irriiTttcative chains 
reprt^sentin^^: dimensions. Having constructea these chains, the ERGO 
procedui-e orders the chains in tenns of maximal iiiunbcr of items 
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contributed. The chain evaliiation procedure can best be explained as 
an atterapt to maximize the number of items accounted for Xfl a given 
dimensional solution. i 

To give additional understanding of both th'd ERGO process and 
the potential advantages a procedure of this type offers,' an empirical 
example which" utilizes social distance items (Bogardus, 1925) paired 
individually with three ethnic groups was analyzed for respondents 
representing four ethnic groups. Emphasized in the solution was the 
duality of relationships inherent in a procedure such as this, that is 
based upon the principles underlying Guttman orders. The results 
demonstrated the ability of ERGO to (l) group items referring to the 
same ethnic group; (2) uncover hierarchically graded orders within 
each chain; (3) select the three chains that corresponjied to the three 
ethnic groups; and (k) cluster individuals by ethnii group according 
to their scores. 

In summary, the ERGO procedure, based on the uncovering of 

logical relationships within the context of a dominance relation and 

postulated in ordering theory (Airasian fit Bart, 1972), has been pro- 

i 

posed. The rationale, upon which a dimension extraction procedure . 
specific to a binary matrix is based, is accomplished by demonstrating 
the shortcomings of currently implemented procedures. Given the 
shortcomings and a definition of the problems confronting a procedure 
lirtaose goal is to analyze the dimensionality of a dominance matrix, an 



\ 
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alternative procedure^ ERGO^ is presented. applying the ERGO pro- 
cedure to well-known social distance type items^ (Bogardus^ .1925)^ 
empiricaJ. validation. of the procedure was attained. 
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8ejt: 
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